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PROCESS AND DEVICE FOR THE COMPRESSION OF PORTIONS OF 

IMAGES 

The present invention relates to a process and a 
5 device for the compression of portions of images. 

It is applicable in particular to the compression of 
sequences of images, for example video, for their 
transmission on a computer network, for example the 
Internet, or for storage on a digital data support. 
10 This process and this device can be integrated into 

any system allowing the compression and then decompression 
of any part of an image on any hardware platform. 

This includes in particular the distribution of video 
film or animated films on computers, consoles or portable 
15 or home video games, personal digital assistant, mobile 
phones, home DVD readers. 

The known standards for video compression, such as 
MPEG (Motion Picture Expert Group) , used two groups 10 0 and 
110 of steps described in Figure 1 to compress the images 
2 0 of a video stream into non intra images, which is to say 
images which are encoded with reference to other images of 
the video stream: 

- the motion estimation 100 which consists in encoding 
each image from elements present in other images of the 
25 video stream (often the preceding image, the last intra 
image or the next intra image) . The steps carried out are 
as follows: 

- step 101: cutting out the image and encoding 
it in blocks of a fixed size L x H pixels (often 
30 16 x 16) ; 

step 102: for each block of the image, 

searching in a preceding image (for example) of 
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the floating zone of L x H pixels that is most 
similar to the block; 

- step 103: storage of the motion vector which 
indicates the motion (in spatial coordinates) 

5 between the block and the most similar zone 

located; 

- step 105: computation of the residue, which is 
to say the difference between the block and the 
most similar zone found. 

10 - motion compensation 110 which consists in 

compressing the residue. The steps carried out are as 
follows: 

step 111: compression of the residue, most 
often thanks to a mathematical function, such as 
15 DCT (discrete cosine transform) ; 

step 112: storage of the compressed residue 
and 

- step 113: return to step 102 to encode the 
following block. 

2 0 The decompression of the video then takes place in the 
f ol lowing manner : 

step 121: decompression of one or several 
intra images (images encoded without reference to 
the other images of the video stream) ; 
25 - group of steps 130: reconstitution of the non 

intra images by carrying out, for each block: 

- step 131: localization, thanks to the motion 
vector, of the most similar zone of another image 
of the video stream; 

30 - step 132: decompression of the residue, and 

step 133: adding the residue to the most 
similar zone to obtain the final block. 
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The conventional algorithms for encoding the residue 
(step 111) achieve suitable compression ratios only under 
the condition of encoding the values of the pixel in the 
format "Luminance Chrominance" (YUV) . For a decompression 
5 on a hardware whose pixel format is "Red Green Blue" (RGB) , 
step 133 must thus comprise moreover a color space 
conversion of YUV to RGB. 

These known standards of video compression are very 
poorly adapted to the display of videos on less powerful 
10 platforms, such as portable game consoles or mobile phones. 

The present invention seeks to overcome this drawback. 
To this end, the present invention provides, according to a 
first aspect, a process for the compression of a block of a 
size L x H of a sequence of images, characterized in that 
15 it comprises, in a repeating manner, for said block: 

- a search step, in one of the images of the sequence 
of images, of the zone of L x H pixels most similar to said 
block; 

a step of determination whether the resemblance 

2 0 between said zone and said block responds to predetermined 

criteria ; 

- if said resemblance responds to said criteria, a 
step of storage of the motion vector which indicates the 
distance between the block and the most similar zone found; 

25 - if said resemblance does not respond to said 

criteria, and if the block does not have a predetermined 
minimum size, a step of cutting out said block into sub- 
blocks and a supplemental repetition, for each of said sub- 
blocks, and 

3 0 if said resemblance does not respond to said 

criteria, and if the block has a predetermined minimum 
size, a step of storage of the block in the course of which 
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the block is compressed without reference to a reference 
image . 

It is noted that the size L x H is generally 16 x 16 
pixels and that the predetermined minimum size is 
5 preferably lxl pixel or 2 x 2 pixels, which allows 
numerous repetitions. Moreover, when the resemblance does 
not respond to the predetermined criteria and the block has 
a predetermined minimum size, it is not the residue which 
is stored but the block itself. 
10 Thanks to these arrangements, the present invention 

makes possible the compression and decompression (and hence 
the display) of image sequences: 

- of a quality equivalent to the conventional coders- 
decoders ("codecs") , 

15 - on hardware platforms not having a sufficient 

machine power for conventional decompression, or even 
on powerful hardware platforms, but as to which it is 
desired to save a part of the power for another use, 

- with a high compression ratio. 

2 0 The process provided by the inventors allows to 

improve considerably the efficiency of the step of motion 
estimation, whereby rendering useless the step of motion 
compensation, which is the step that is most costly during 
decompression . 

25 It will be noted that by eliminating the step of 

motion compensation, the present invention also eliminates 
the step of color space conversion, necessary for certain 
hardwares with the conventional algorithms. As to these 
hardwares, their speed of decompression is thus further 

30 improved relative to the state of the art. 

According to particular characteristics: 
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in the course of the search step, there is 
conjointly determined a transformation of a zone which 
supplies the transformed zone that is most similar to said 
block, 

5 in the course of the determination step, it is 

determined whether the resemblance between said transformed 
zone and said block responds to predetermined criteria, and 

- in the course of the vector storage step, if said 
zone after said transformation is the one that bears the 
10 most resemblance, the data representative of said 
transformation are stored. 

Thanks to these arrangements, the compression ratio is 
increased . 

According to particular characteristics, in the course 
15 of the storage step of the block of minimal size, the block 
is compressed without reference to a reference image. 

Thanks to these arrangements, the compression ratio 
and the quality of compression are increased. 

According to particular characteristics, in the course 
2 0 of the search step, there are searched among a plurality of 
images of the sequence of images, the zone of L x H pixels 
the most similar to said block and in the course of the 
vector storage step, the data representative of the image 
which comprise said zone are stored. 

2 5 Thanks to these arrangements, the choice between the 

candidate zones is greater, which allows to increase the 
compression ratio. 

According to particular characteristics, in the course 
of the search step, search is conducted only in the 

3 0 preceding image of the sequence of images, for the zone of 

L x H pixels that is the most similar to said block. 
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Thanks to these arrangements, the quantity of 
compression is increased because it is not necessary to 
store data representative of the image which comprises said 
zone . 

5 According to particular characteristics, in the course 

of the step of cutting out, said block is cut in two sub- 
blocks of the same dimensions. 

Thanks to these arrangements, the number of sub-blocks 
to be treated is reduced, which increases the speed of 
10 compression. 

According to particular characteristics, in the course 
of each cutting out step, the block or the sub-block is cut 
out, on the one hand, vertically and, on the other hand, 
horizontally and, in the course of a selection step, there 
15 is selected the cutout which optimizes the overall 
resemblance of the sub-blocks generated by each of said 
cutting out steps, with zones of said images of the image 
sequence . 

Thanks to these arrangements, the quality of 
2 0 compression is improved. 

According to particular characteristics, the 
predetermined criteria depend on the dimensions of the 
block in question. 

The present invention provides, according to a second 
25 aspect, a device for compression of a block of a size L x H 
of a sequence of images, characterized in that it comprises 
a processing means adapted to control in a repeating manner 
for said block: 

- a search means which searches in one of the images 
30 in the sequence of images, for the zone L x H pixels that 
is most similar to said block, 



- a determination means which determines whether the 
resemblance between said zone and said block responds to 
predetermined criteria, 

if said resemblance responds to said criteria, a 
5 storage means which stores the motion vector which 
indicates the distance between the block and the zone that 
has been found to be the most similar; 

if said resemblance does not respond to said 
criteria, and if the block has no minimum predetermined 
10 size, a cutout means which cuts out said block into sub- 
blocks, a supplemental repetition being carried out for 
each of said sub-blocks and 

if said resemblance does not respond to said 
criteria, and if the block has a predetermined minimal 
15 size, a storage means which compresses the block without 
reference to a reference image and stores the compressed 
block . 

The present invention seeks, according to a third 
aspect, to provide a process for decompression of an image 
20 block, characterized in that it comprises, in a repeating 
manner : 

- a step of reading information representative of the 
block; 

a step of determination whether said block is 
2 5 encoded in the form of several sub-blocks; 

- if said block is not encoded, under the form of 
several sub-blocks, a step of determination whether the 
block has a predetermined minimum size; 

- if said block is not encoded in the form of several 
30 sub-blocks and does not have a predetermined minimal size, 

a step of decompression of said block by reading of a 
motion vector and simple copying of the block of the same 
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dimensions corresponding to said motion vector, in a 
reference image, 

- if said block is not encoded in the form of several 
sub-blocks and has a predetermined minimum size, a step of 

5 decompression of said block according to a decompression 
method which does not make reference to a reference image, 
and 

- if said block is encoded in the form of several sub- 
blocks, a return to the steps of determination for each of 

10 said sub-blocks. 

The present invention seeks, according to a fourth 

aspect, a device for decompression of an image block, 

characterized in that it comprises a processing means (410) 

adapted to control in a repeating manner: 
15 - a reading means which reads information 

representative of said block; 

- a determination means which determines whether said 
block is encoded under the form of several sub-blocks; 

- if said block is not encoded in the form of several 
2 0 sub-blocks, a determination means which determines whether 

the block has a predetermined minimum size; 

- if said block is not encoded in the form of several 
sub-blocks and does not have a predetermined minimum size, 
a decompression means which decompresses said block by 

2 5 reading of a motion vector and simply copies the block of 

the same dimensions corresponding to said motion vector, in 
a reference image, 

- if said block is not encoded in the form of several 
sub-blocks and has a predetermined minimum size, a 

3 0 decompression means which decompresses said block according 

to a decompression method that does not make reference to a 
reference image , and 



- if said block is encoded in the form of several sub- 
blocks, a new repetition for each of said sub-blocks. 

The advantages, objects and characteristics of the 
processes and of the device contemplated by the second, 
5 third and fourth aspect of the present invention being 
similar to those of the decompression process as briefly 
pointed out above, they are not repeated here. 

Other advantages, objects and characteristics of the 
present invention will become apparent from the description 
10 which follows, given with respect to the accompanying 
drawings, in which: 

- Figure 1 shows, in the form of a logical diagram, a 
process according to the prior art set forth in the 
preamble , 

15 - Figure 2 shows, in the form of a logical diagram, a 

particular embodiment of the process of the present 
invention, 

Figure 3 shows image blocks in the course of 
processing, 

20 - Figure 4 shows, schematically, a particular 

embodiment of the device of the present invention, and 

- Figure 5 shows, in the form of a logical diagram, a 
particular embodiment of a decompression of compressed 
images with the process of the present invention. 

25 There will be seen, in Figure 2, a step 200 of 

starting the compression device of sequences of images, 
then a step 2 05 for loading a first image of a sequence of 
images. A value H is preferably a power of 2 which divides 
the number of lines of the image in question (for example 

30 16 for an image of 512 lines) and L is a power of 2 which 
divides the number of columns of the image in question (for 
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example 16 for an image of 768 columns) . The list of the 
selected blocks is empty. 

In the course of a step 210, the first image is 
compressed in a known manner, for example without reference 
5 to a reference image (intra frame) . 

In the course of a step 220, the following image in 
the sequence of images is selected. In the course of a 
step 225, the image in question is cut out into blocks of H 
pixels in height and L pixels in width. 

10 In the course of a step 230, the first image block in 

question is added to the list of selected blocks. 

In the course of a step 235, it is determined whether 
the list of selected blocks is empty. 

If it is, in the course of a step 236 it is determined 

15 whether there exists an image to be processed in the 
sequence of images. If there is, we return to step 220. 
If not, the processing is finished. 

If the result of step 235 is negative, which is to say 
if there are blocks in the list of selected blocks, in the 

20 course of a step 240, the first block is removed from the 
list and it is compared to the floating blocks of the same 
size of the preceding images, called "zones" in what 
follows, and the zone of one of the preceding images the 
most similar to the block in question is detected as well 

25 as the transformation if desired (for example, horizontal 
and vertical symmetries, increase/decrease of luminance, 
rotation and combination of all these transformations) 
which most greatly increases the similarity between the 
predetermined zone and the block in question. 

30 It will be noted that the criteria of possible 

comparison are very numerous to determine the best 
similarity between a block and a zone. By way of 
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illustration, the MPEG standard does not specify what 
method should be used to compare 2 blocks . Each person 
skilled in the art selects his own solution. The two 
functions that are the most used are "Mean Square 
5 Difference" or U MSD" and "Mean Absolute Difference" or 
"MAD" . 

It will be noted that, theoretically, a process for 
compression could run through a large number of images to 
find the most similar zone, if desired after 
10 transformation, so as to find the block most similar or 
most closely resembling. In practice, the search is 
preferably limited by using one of the following 
strategies : 

- search in the preceding image, 
15 - search in the last intra image, 

- search in the last intra image and the next intra 
image . 

In the course of a step 245, it is determined whether 
the most similar zone, if desired transformed, responds to 
20 predetermined resemblance criteria as to the block in 
question. 

Preferably, the predetermined criteria depend on the 
size of the blocks in question (this size varies in the 
course of repetitions) . 

25 If the result of step 245 is positive, in the course 

of a step 250, the motion vector is determined which causes 
the spatial coordinates of the block in question to pass to 
the spatial coordinates of the most similar zone. In the 
course of a vector storage step 255, there are stored in 

3 0 the memory representative data: 

- of the fact that the data which will follow are 
relative to a block described by a motion vector, 
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- of the transformation determined in the course of 
step 240, 

of the image to which the most similar zone 
pertains, and 

5 - of the motion vector determined in the course of 

step 250. 

It will be noted that the stored data are compressed 
by using standard compression techniques, with or without 
loss and, preferably standard compression techniques 
10 without loss. 

As a modification, only the preceding image is 
considered and the data representative of the preceding 
image are not stored. 

In the course of a step 256, the block following the 
15 image in question, if there is one, is added to the list of 
selected blocks, then one returns to step 235. 

If the result of step 245 is negative, in the course 
of a step 260, it is determined whether the block has a 
predetermined minimum size (for example 1 x 1 or 1 x 2 
2 0 pixels) by determining whether its height and width are 
equal to predetermined minimum values (for example 1 and 1, 
or 1 and 2) . 

If so, in the course of a step 265 the block of 
minimum size in question is compressed in a known manner, 
2 5 without reference to a reference image. 

and, in the course of a storage step of block 266, 
there is stored in the memory: 

information indicating that the data which will 
follow relate to a minimum block, and 
30 - the result of the compression. 



12 



Then, in the course of a step 270, the following block 
of the image in question is added, if there is one, to the 
list of selected blocks, then one returns to step 235. 

If the result of step 260 is negative, which is to say 
5 that the block does not have a predetermined minimum size, 
in the course of a step 280, the block in question is 
divided into two equal sub-blocks along a vertical division 
into two right and left parts of equal sizes (see Figure 3) 
and a step 240 is simulated to test each of the sub-blocks 

10 thus considered. In the course of a step 2 81, the block in 
question is divided into two equal sub-blocks along a 
horizontal division into two upper and lower portions of 
equal dimensions and a step 240 is simulated to test each 
one of the sub-blocks thus considered. Thus, the two types 

15 of divisions create sub-blocks for which the similarity has 
been determined, then, in the course of a step 282, the 
division (vertical or horizontal) is selected which gives 
the best overall similarity, which is to say which 
optimizes, according to predetermined criteria (for example 

20 the sum of the absolute values and the differences of the 
blocks with the best zones, if desired transformed) , the 
overall resemblance of the generated sub-blocks, 
considering each of the vertical and horizontal cutouts, 
with zones of said images of the sequence of images. 

25 As a modification, one chooses arbitrarily one of the 

divisions (for example, only the vertical division during 
the first step of division, then the horizontal division, 
then the vertical division...) . This renders compression 
more rapid, but at the price of a less good compression. 

3 0 In the course of an information storage step of 

division 283, there is stored in the memory: 
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information indicating that the data which follow 
relate to a division of a block into two sub-blocks. 
- information which indicates whether the block has 
been divided vertically or horizontally. 
5 In the course of a step 285, there is added to the 

list of selected blocks the two sub-blocks resulting from 
the vertical or horizontal division of the block, then one 
returns to step 235. 

It will be noted that the recursive subdivision set 
10 forth above allows to isolate in an efficient manner the 
so-called blocks "of change", statistically less numerous, 
for which no zone of preceding image is sufficiently 
similar. The rest of the image, the greater portion, is 
encoded only by estimation of motion, allowing a high 
15 compression ratio and a high speed of decompression. 

As a modification, steps 240 and 245 are reversed, 
step 245 in the course of which it is determined whether 
the most similar zone responds to predetermined resemblance 
criteria with the block in question, being carried out on 
20 the forward block of a possible transformation. 

As a modification, step 240 is eliminated, step 245 in 
the course of which it is determined whether the most 
similar zone responds to predetermined resemblance criteria 
with the block in question being carried out on the block 
2 5 without transformation. 

There will be noted in Figure 3 a square block 310, 
for example 32 x 32 pixels from a first cutout of an image 
305 of blocks. If a step 280 is carried out on the block 
310, in the course of this step 280, this block is divided 
30 into two sub-blocks 320 and 330, constituted for example of 
equal parts, right and left, of the block 310. The height 
of the sub-blocks 320 and 330 is 32 pixels and their width 
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is 16 pixels. If a step 281 is carried out on the block 
320, in the course of this step 281, this block is divided 
into two sub-blocks 340 and 350, for example constituted by 
equal portions, upper and lower, of the block 320. The 
5 height of the sub-blocks 340 and 350 is 8 pixels and their 
width is 8 pixels. If supplemental division steps are 
carried out, the successive divisions divide the sub-block 
into two equal parts. 

There will be noted in Figure 4 a device 400 
10 comprising a processor 410 and a memory 420 adapted to 
store : 

- software instructions allowing the practice of the 
process of compression set forth above with respect to 
Figures 2 and 3 and/or of the process of decompression set 

15 forth below with respect to Figure 5, 

- data of images of a sequence of images, in non intra 
format and in compressed and/or decompressed format. 

The processor 410 is adapted to carry out instructions 
of the software embedded in memory 42 0 and to transmit or 
2 0 receive the data of images that are compressed or not. For 
example, the processor is of the type Intel Pentium 4 
(trademark) . 

The memory 42 0 can comprise at least one electronic 
component, for example an integrated circuit, a diskette, a 
25 hard disc and/or an optical disc, for example a compact 
disc, re-recordable or not. 

The processor or processing means 410 comprises and is 
adapted to control, in a repeating manner for said block: 

- a search means which searches, in one of the images 
30 of the sequence of images, among the zone of L x H pixels, 

the one most similar to said block; 
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- a determination means which determines whether the 
resemblance between said zone and said block responds to 
predetermined criteria; 

if said resemblance responds to said criteria, a 
5 storage means which stores the motion vector which 
indicates the distance between the block and the most 
similar zone found; 

if said resemblance does not respond to said 
criteria, and if, the block does not have a predetermined 
10 minimum size, a cutout means which cuts out said block into 
sub-blocks, a supplemental repetition being carried out for 
each of said sub-blocks and 

if said resemblance does not respond to said 
criteria, and if said block has a predetermined minimum 
15 size, a storage means which compresses the block without 
reference to a reference image and stores the compressed 
block. 

The processor or processing means 410 comprises and is 
adapted to control, in a repetitive manner: 

2 0 - a reading means which reads the information 

representative of the block; 

a means for determining whether said block is 
encoded in the form of several sub-blocks; 

- if said block is not encoded in the form of several 
25 sub-blocks, a means for determining whether the block has a 

predetermined minimum size; 

- if said block is not encoded in the form of several 
sub-blocks and does not have a predetermined minimum size, 
a decompression means which reads a motion vector and 

3 0 copies the block of the same dimensions corresponding to 

said motion vector, in a reference image, 
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- if said block is not encoded in the form of several 
sub-blocks and has a predetermined minimum size, a 
decompression means which decompresses said block according 
to a decompression method that does not make reference to a 

5 reference image , and 

- if said block is encoded in the form of several sub- 
blocks, a new repetition for each of said sub-blocks. 

There will be noted, in Figure 5, in the form of a 
logical diagram, a process for decompression of compressed 

10 images with the process according to the present invention. 

In the course of a step 500, a decompression of one or 
several intra images is carried out (images encoded without 
reference to other images of the video stream) . 

Then, in the course of a step 505, the stored 

15 information is read concerning a block describing the type 
of data which will follow and the nature of the stored 
information representative of said block is determined. If 
it is a matter of a motion vector relative to a preceding 
image zone, the group of steps 510 is carried out. If it 

20 is a matter of a block of minimum size, the group of steps 
520 is carried out. If it is a matter of a division of the 
block into two sub-blocks, the group of steps 53 0 is 
carried out . 

It is to be noted that the size of the block in the 
25 course of decompression is continuously known: it is 16 x 
16 pixels if step 530 has never been carried out, 8 x 16 or 
16 x 8 pixels if a single step 53 0 has been carried out, 
etc . 

- the group of steps 510 allows to decompress a block 
30 described by a motion vector: 

- in the course of a step 511, the motion vector 
determined in the course of step 250 is read, 
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and, thanks to said vector, the zone most similar 
to another image of the video stream is located. 

- in the course of a step 512, the predetermined 
transformation in the course of step 235 is 

5 applied if desired, and 

- in the course of a step 513, the most similar 
zone (possibly transformed) is recopied to obtain 
the decompressed block; 

- the group of steps 520 allows to decompress a block 
10 of minimum size stored in the course of step 266: 

in the course of a step 521, the compressed 
block is read, and 

- in the course of a step 522, the read block is 
decompressed, with known decompression 

15 techniques, to obtain the decompressed block; 

- the group of steps 530 allows to decompress a block 
described by a division into two sub-blocks: 

- in the course of a step 531, the information is 
read which is determined in the course of step 

20 282, which determines whether the block has been 

divided horizontally or vertically. 

in the course of a step 532, one returns 
successively to step 505 for the two sub-blocks 
thus determined. 

25 Following one or the other of steps 513 or 522, one 

returns to step 505 to read the stored information relating 
to the next block so far as long as remains a block or an 
image to be processed. 

It will be noted that the process of cutting out the 

30 blocks into rectangular sub-blocks of multiple size of 
powers of 2 is but an example of embodiment. The invention 
is not limited to this example and can on the contrary 
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carry out divisions into three sub-blocks or more, of 
arbitrary shapes. 

The present invention is not limited to the 
compression of a block within an image of a sequence of 
5 images but extends to the codecs which use several methods 
(as a function of certain criteria) to encode the different 
blocks of a same image as well as to the codecs which use 
the process briefly set forth above to encode an image cut 
out into blocks of variable sizes and to codecs which use 
10 this process to encode only certain portions of each image. 
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